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Check & Connect 

No studies of Check & Connect that fall within the scope of the Children Classified as Having an 
Emotional Disturbance review protocol meet What Works Clearinghouse (WWC) evidence standards. 
The lack of studies meeting WWC evidence standards means that, at this time, the WWC is unable to 
draw any conclusions based on research about the effectiveness or ineffectiveness of Check & Connect 
on children classified as having an emotional disturbance or students at risk for classification. Addi- 
tional research is needed to determine the effectiveness or ineffectiveness of this intervention. 

Program Description^ 

Check & Connect is designed to promote students’ engagement with school and learning. Students may be referred 
to the program if they exhibit academic, emotional, or behavioral warning signs. Check & Connect is implemented by 
a monitor, who is a combination of a student mentor, an advocate, and a service coordinator. The monitor’s primary 
goal is to keep education a salient issue for disengaged students and their teachers and family. Student levels of 
engagement (such as attendance, grades, and suspensions) are “checked” regularly and used to guide the monitors’ 
efforts to increase and maintain the students’ “connection” with school. 

Research^ 

The WWC identified 25 studies of Check & Connect for children classified as having an emotional disturbance that 
were published or released between 1989 and 201 1 . 

Three studies are within the scope of the Children Classified as Having an Emotional Disturbance review protocol 
but do not meet evidence standards. 

• Two studies did not establish that the comparison group was comparable to the treatment group prior to the 
start of the intervention. One of these used a quasi-experimental design, and the other was a randomized 
controlled trial with high attrition. 

• One study had only one unit assigned to the treatment condition and one unit assigned to the control condition, 
which makes it impossible to attribute the observed effect solely to Check & Connect. 

Twenty-two studies are outside the scope of the Children Classified as Having an Emotional Disturbance review 
protocol. 

• Fifteen studies are literature reviews or meta-analyses. 

• Six studies did not use an eligible study design (comparison group or single-case). 

• One study did not confirm that at least 50% of students in the study sample were at-risk for emotional disturbance 
or classified as emotionally disturbed, as required for review under this protocol. 
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Glossary of terms and criteria for study rating, effectiveness rating, and extent of evidence 



Attrition 


Attrition occurs when an outcome variable is not available for all participants initially 




assigned to the intervention and comparison groups. The WWC considers the total 
attrition rate and the difference in attrition rates across groups within a study. 


Ciustering adjustment 


If treatment assignment is made at a cluster level and the analysis is conducted at 
the student level, the WWC will adjust the statistical significance to account for this 
mismatch, if necessary. 


Design 


The design of a study is the method by which intervention and comparison groups 
were assigned. 


Domain 


A domain is a group of closely related outcomes. 


Effect size 


The effect size is a standardized measure of the magnitude of an effect that is compa- 
rable across studies and outcomes. 


Eligibiiity 


A study is eligible for review If It falls within the scope of the review protocol and uses 
a causal design (RCT or QED). 


Equivalence 


A demonstration that the analysis sample groups are similar on observed characteristics 
defined in the review area protocol. 


Extent of evidence 


An indication of how much evidence supports the findings. The criteria for the extent 
of evidence levels are in the WWC Procedures and Standards Handbook (version 2.1). 


Improvement index 


Along a percentile distribution of students, the improvement index represents the gain 
or loss of the average student due to the Intervention. As the average student starts at 
the 50th percentile, the measure ranges from -50 to +50. 


Multiple comparison 
adjustment 


When a study includes multiple outcomes or comparison groups, the WWC will adjust 
the statistical significance to account for the multiple comparisons, if necessary. 


Quasi-experimental 
design (QED) 


A quasi-experimental design (QED) is a research design in which subjects are 
assigned to treatment and comparison groups through a process that is not random. 


Randomized controlled 
trial (RCT) 


A randomized controlled trial (RCT) is an experiment in which investigators randomly 
assign eligible participants Into treatment and comparison groups. 


Rating of effectiveness 


The WWC rates the effects of an intervention in each domain based on the quality of 
the research design and the magnitude, statistical significance, and consistency in 
findings. The criteria for the ratings of effectiveness are given in the WWC Procedures 
and Standards Handbook (version 2.1). 
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Standard deviation 


The standard deviation across ail students in a group shows how dispersed the outcomes 
are. A measure with a smail standard deviation would indicate that participants had 
more similar outcomes than a measure with a iarge standard deviation. 


Statistical significance 


Statistical significance is the probability that the difference between groups is a result 
of chance rather than a real difference between the groups. The WWC labels a finding 
statistically significant if the likelihood that the difference is due to chance is less than 
5% (p < 0.05). 


Substantively 

important 


A substantively important finding is one that has an effect size of 0.25 or greater, 
regardless of statistical significance. 



Please see the WWC Procedures and Standards Handbook (version 2.0) for additional details. 
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Endnotes 

■' The descriptive information for this program was obtained from a publicly available source: the program’s website (http://ici.umn. 
edu/checkandconnect/default.html, downloaded March 201 0). The WWC requests developers to review the program description 
sections for accuracy from their perspective. The program description was provided to the developer In March 2010. Further verifica- 
tion of the accuracy of the descriptive information for this program is beyond the scope of this review. The literature search reflects 
documents publicly available by August 201 1 . 

^ The studies in this report were reviewed using WWC Evidence Standards, Version 2.0, as described in protocol Version 2.0. The 
evidence presented in this report is based on available research. Findings and conclusions may change as new research becomes 
available. 
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